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,_. Abstract 

We study distributed optimization in networked systems, where nodes cooperate to find the optimal 

quantity of common interest, x — x*. The objective function of the corresponding optimization problem 

O is the sum of private (known only by a node,) convex, nodes' objectives and each node imposes a private 

convex constraint on the allowed values of x. We solve this problem for generic connected network 

CN 

^- topologies with asymmetric random link failures with a novel distributed, decentralized algorithm. We 

refer to this algorithm as AL-G (augmented Lagrangian gossiping,) and to its variants as AL-MG 

-y~. (augmented Lagrangian multi neighbor gossiping) and AL-BG (augmented Lagrangian broadcast gos- 

£ — . siping.) The AL-G algorithm is based on the augmented Lagrangian dual function. Dual variables are 

o 

updated by the standard method of multipliers, at a slow time scale. To update the primal variables, we 
propose a novel, Gauss-Seidel type, randomized algorithm, at a fast time scale. AL-G uses unidirectional 
gossip communication, only between immediate neighbors in the network and is resilient to random link 
failures. For networks with reliable communication (i.e., no failures,) the simplified, AL-BG (augmented 



cd 



Lagrangian broadcast gossiping) algorithm reduces communication, computation and data storage cost. 
We prove convergence for all proposed algorithms and demonstrate by simulations the effectiveness on 
two applications: l\ -regularized logistic regression for classification and cooperative spectrum sensing 
for cognitive radio networks. 
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I. Introduction 

Recently, there has been increased interest in large scale networked systems including networks of 
agents, wireless ad-hoc networks, and wireless sensor networks (WSNs.) Typically, these systems lack a 
central unit, and the inter-node communication is prone to random failures (e.g., random packet dropouts 
in WSNs.) In this paper, we consider a generic computational model that captures many applications in 
networked systems. With this model, nodes cooperate to find the optimal parameter (scalar or vector) of 
common interest, x = x*, e.g., the optimal operating point of the network. Each node i has a private 
(known only at node i) cost function of x, e.g., a loss at node i if operating at x. The total cost is the 
sum over the individual nodes' costs. Also, each node imposes a private constraint on the allowed values 
of x (e.g., allowed operating points at node i.) Applications of this computational model include resource 
allocation in wireless systems [1], distributed estimation in wireless sensor networks, [2], and distributed, 
cooperative spectrum sensing in cognitive radio networks, [3], [4]. 

More formally, nodes cooperatively solve the following optimization problem: 

minimize YlZi M x ) 

subject to x G Xi, i = 1, ..., N 

Here N is the number of nodes in the network, the private cost functions /, : W 71 — > R are convex, and 
each fi(-) is known locally only by node i. The sets Xi are private, closed, convex constraint sets. We 
remark that (1) captures the scenario when, in addition to private constraints, there is a public constraint 
i£l (where X is a closed, convex set,) just by replacing Xi with Xi n X. 

This paper proposes a novel augmented Lagrangian (AL) primal-dual distributed algorithm for solv- 
ing (1), which handles private costs /»(•), private constraints Xi, and is resilient to random communication 
failures. We refer to this algorithm as AL-G (augmented Lagrangian gossiping.) We also consider two 
variants to AL-G, namely, the AL-MG (augmented Lagrangian multiple neighbor gossiping) and the AL- 
BG (augmented Lagrangian broadcast gossiping.) The AL-G and AL-MG algorithms use unidirectional 
gossip communication (see, e.g., [5]). For networks with reliable communication (i.e., no failures,) we 
propose the simplified AL-BG algorithm with reduced communication, reduced computation, and lower 
data storage cost. Our algorithms update the dual variables by the standard method of multipliers, [6], 
synchronously, at a slow time scale, and update the primal variables with a novel, Gauss-Seidel type (see, 
e.g., [7]) randomized algorithm with asynchronous gossip communication, at a fast time scale. Proof of 
convergence for the method of multipliers (for the dual variables update) is available in the literature, 
e.g., [6]. However, our algorithms to update primal variables (referred to as P-AL-G (primal AL gossip), 
P-AL-MG and P-AL-BG) are novel, a major contribution of this paper is to prove convergence of the 



P-AL-G, for private constraints, under very generic network topologies, random link failures, and gossip 
communication. The proof is then adapted to P-AL-MG and P-AL-BG. 

The AL-G (and its variants AL-MG and AL-BG) algorithms are generic tools that fit many applications 
in networked systems. We provide two simulation examples, namely, l\ -regularized logistic regression for 
classification and cooperative spectrum sensing for cognitive radio networks. These simulation examples: 
1) corroborate convergence of the proposed algorithms; and 2) compare their performance, in terms of 
communication and computational cost, with the algorithms in [8], [9], [4], [3]. 

Comparison with existing work. We now identify important dimensions of the communication and 
computation models that characterize existing references and that help to contrast our paper with the 
relevant literature. Optimization algorithms to solve (1), or problems similar to (1), in a distributed 
way, are usually either primal-dual distributed algorithms or primal subgradient algorithms. Optimization 
constraints on problem (1) can either be: no constraints (Xi = IR m ); public constraints (Xi = X); and 
private constraints Xi. The underlying communication network can either be static (i.e., not varying 
in time,) or dynamic (i.e., varying in time.) A dynamic network can be deterministicaily or randomly 
varying. Link failures can be symmetric or asymmetric; that is, the random network realizations can be 
symmetric or, more generally, asymmetric graphs, the latter case being more challenging in general. The 
communication protocol can either be synchronous, or asynchronous, i.e., of gossip type, [5]. We next 
review the existing work with respect to these four dimensions. 

Primal subgradient algorithms. References [10], [8], [11], [9] and [12] develop primal subgradient 
algorithms, with [10], [8], [11], [9] assuming synchronous communication. References [11] and [9] 
consider a deterministicaily varying network, with [11] for the unconstrained problem and [9] for public 
constraints. References [8] and [10] consider random networks; reference [8] is for public constraints, 
while [10] assumes private constraints. Both references [10] and [8] essentially handle only symmetric 
link failures, namely, they use local weighted averaging as an intermediate step in the update rule 
and constrain the corresponding averaging matrix to be doubly stochastic. In practice, these translate 
into requiring symmetric graph realizations, and, consequently, symmetric link failures. Reference [12] 
presents a primal subgradient algorithm for unconstrained optimization and static network and uses the 
gossip communication protocol. Finally, reference [13] studies a generalization of problem (1), where the 
objective function Yli=\ fi( x ) i s replaced by g ( Yli=i fi( x ) ) ; that i s > an outer public, convex function g(-) 
is introduced. The optimization problem in [13] has public constraints, the communication is synchronous, 
and the network is deterministicaily time varying. Reference [13] proposes a distributed algorithm where 
each node i, at each time step k, updates two quantities: an estimate of the optimal solution Xi(k), and 
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an estimate of the quantity (1/N) Ylj=i fj( x i(k))> by communicating with immediate neighbors only. 
When the algorithm in [13] is applied to (1), it reduces to the primal subgradient in [9]. 
Primal-dual algorithms. As far as we are aware, primal-dual algorithms have been studied only for 
static networks. For example, references [4], [3] consider a special case of (1), namely, the Lasso (least- 
absolute shrinkage and selection operator) type problem. They propose the AD-MoM (alternating direction 
method of multipliers) type primal-dual algorithms for static networks, synchronous communication, and 
no constraints. Reference [14] applies AD-MoM to various statistical learning problems, including Lasso, 
support vector machines, and sparse logistic regression, assuming a parallel network architecture (all nodes 
communicate with a fusion node,) synchronous communication, and no link failures. 

In this paper, rather than subgradient type, we provide and develop a AL primal-dual algorithm for the 
optimization (1) with private costs and private constraints, random networks, and asynchronous gossip 
communication. In contrast with existing work on primal-dual methods, for example, [4], [3], our AL-G 
handles private constraints, random networks, asymmetric link failures, and gossip communication. * 
Paper organization. Section II introduces the communication and computational model. Section III 
presents the AL-G algorithm for the networks with link failures. Section IV proves the convergence of 
the AL-G algorithm. Section V studies the variants to AL-G, the AL-MG, and AL-BG algorithms. 
Section VI provides two simulation examples: 1) /i-regularized logistic regression for classification; 
and 2) cooperative spectrum sensing for cognitive radios. Finally, section VII concludes the paper. The 
Appendix proves convergence of AL-MG and AL-BG. 

II. Problem model 

This section explains the communication model (the time slotting, the communication protocol, and 
the link failures,) and the computation model (assumptions underlying the optimization problem (1).) 
Network model: Supergraph. The connectivity of the networked system is described by the bidirectional, 
connected supergraph G = (M,E), where J\f is the set of nodes (with cardinality \J\f\ = N) and E is 
the set of bidirectional edges {i,j} (\E\ = M). The supergraph G is simple, i.e., there are no self-edges. 
Denote by 0^ C M, the neighborhood set of node i in G, with cardinality di = |fij|. The integer di 
is the (supergraph) degree of node i. The supergraph G models and collects all (possibly unreliable) 
communication channels in the network; actual network realizations during the algorithm run will be 
directed subgraphs of G. We denote the directed edge (arc) that originates in node i and ends in node 
j either by (i,j) or i — > j, as appropriate. The set of all arcs is: E& = {(i,j) : {i,j} £ E}, where 

'AL-G algorithm uses asynchronous gossip communication, but it is not completely asynchronous algorithm, as it updates 
the dual variables synchronously, at a slow time scale (as details in Section IV.) 
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\Ed\ = 2M. We assume that the supergraph is known, i.e., each node knows a priori with whom it can 

communicate (over a possibly unreliable link.) 

Optimization model. We summarize the assumptions on the cost functions fi(-) and /(•), f(x) := 

Yli=i fi( x )> an d the constraint sets Xi in (1): 

Assumption 1 We assume the following for the optimization problem (1): 

1) The functions f\ : W 71 — > R are convex and coercive, i.e., fi(x) — > oo whenever ||x|| — > oo. 

2) The constraint sets Xi C M. m are closed and convex, and X := C\f =l Xi is nonempty. 

3) (Regularity condition) There exists a point xo G ri {Xi), for all i = 1, ..., N. 

Here ri (S) denotes the relative interior of a set S C W 71 (see [15]). We will derive the AL-G algorithm to 
solve (1) by first reformulating it (see ahead eqn. (2),) and then dualizing the reformulated problem (using 
AL dual.) Assumption 1.3 will play a role to assure strong duality. This will be detailed in subsection 
III-A. Note that Assumption 1.3 is rather mild, saying only that the intersection of the Afj's, i = 1, ..., N, 
is "large" enough to contain a point from the relative interior of each of the A^'s. Denote by /* the 
optimal value and X* = I x* G X : Yli=i fi( x *) = /* f tne solution set to (1). Under Assumptions 1, 
f* is finite, and X* is nonempty, compact, and convex, [16]. The model (1) applies also when Xi = M m , 
for i's in a subset of {l,...,iV}. The functions fi(-), /(■) need not be differentiable; /(■) satisfies an 
additional mild assumption detailed in Section IV. 

We now reformulate (1) to derive the AL-G algorithm. Start by cloning the variable x G M. m and 
attaching a local copy of it, Xj G IR"\ to each node in the network. In addition, introduce the variables 
yij G W 11 and y^ G M. m , attached to each link {i,j} in the supergraph. To keep the reformulated problem 
equivalent to (1), we introduce coupling constraints x« = y^, (i,j) G Ed and y^ = yji, {i,j} G E. The 
reformulated optimization problem becomes: 

minimize J2i=i fi( x i) 
subject to Xi G Xi, i = 1, ..., N, 
Xi = Vij, (i,j) G E d 
yij =Vjh {hJ} G E. 
The variables Xj and y^ may be interpreted as virtual nodes in the network (see Figure 1.) Physically, 
the variables Xj, y^, j G Qi are maintained by (physical) node i. The virtual link between nodes x» and 
yij is reliable (non-failing,) as both Xi and y^ are physically maintained by node i. On the other hand, 
the virtual link between y^ and yji may be unreliable (failing,) as this link corresponds to the physical 
link between nodes i and j. 
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Physical node 1 __ -__^ Physical node 3 



Fig. 1. Illustration of the reformulation (2) for a chain supergraph with TV = 3 (physical) nodes. 

The optimization problems (1) and (2) are equivalent because the supergraph is connected. The 
optimal value for (2) is equal to the optimal value for (1) and equals /*; the set of solutions to (2) 
is \ {x*}, {y*j} : x\ = x*, Mi = 1, ..., N, y*- = x*, V(i, j) G E d , for somex* G Af* >. 
Time slotting. As we will see in section III, the AL-G algorithm (and also its variants AL-MG and 
AL-BG in section V) is based on the AL dual of (2). The AL-G operates at 2 time scales: the dual 
variables are updated at a slow time scale, and the primal variables are updated at a fast time scale. 
Thus, accordingly, the time is slotted with: 1) slow time scale slots {£}; and 2) fast time scale slots {k}. 
Fast time scale slots (for the primal variables update) involve asynchronous communication between the 
nodes in the network and are detailed in the next paragraph. At the end of each t-slot, there is an idle 
time interval with no communication, when the dual variables are updated. The dual variables update at 
each node requires no communication. 

Fast time scale slots {A;} and asynchronous communication model. We now define the fast time scale 
slots {k} for the asynchronous communication and the primal variables update. We assume the standard 
model for asynchronous communication [5], [17]. Each node (both physical and virtual) has a clock that 
ticks (independently across nodes) according to a A-rate Poisson process. Denote the clocks of x, and 
yij by Tf and Tf-, respectively. If Tf ticks, a virtual communication from j/y, Vj G Oj, to xi, follows. 
With the AL-G algorithm, this will physically correspond to the update of the variable Xj, as we will 
see later. If the clock Tf ticks, then (virtual) node y^ transmits to y^ (physically, node i transmits to 
node j.) We will see later that, after a (successful) communication y^ — > yji, the update of y^ follows. 
We also introduce a virtual clock T that ticks whenever one of the clocks Tf, Tf-, ticks; the clock T 
ticks according to a (TV + 2M)-rate Poisson process. Denote by r^, k = 1, 2, ... the times when the A:-th 

tick of T occurs. The time is slotted and the A;-th slot is [rjt_i, Tfc), To = 0, k = 1, 2, ..? 
Random link failures. Motivated by applications in wireless networked systems, we allow that transmis- 
sions yij — > yji may fail. (Of course, the transmissions through the virtual links yij — > x% do not fail.) To 
formally account for link failures, we define the N x N random adjacency matrices A(k), k = 1,2,...; the 
matrix A(k) defines the set of available physical links at time slot k. We assume that the link failures are 

2 For notation simplicity, at the beginning of each f-slot, we reset to to zero, and we start counting the fc-slots from k — 1. 
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temporally independent, i.e., {A(k)} are independent identically distributed (i.i.d.) The entries Aij(k), 
(i,j) £ Ed, are Bernoulli random variables, Aij(k) ~ Bernoulli {ttij), itij = Prob (Aij(k) = 1) > 0, 
and Aij(k) = 0, for (i,j) £ E&. We allow Aij(k) and Ai m (k) to be correlated. 3 At time slot k, at 
most one link (i,j) G Ed is activated for transmission. If it is available at time k, i.e., if Aij(k) = 1, 
then the transmission is successful; if the link (i,j) is unavailable (Aij(k) = 0,) then the transmission is 
unsuccessful. We assume naturally that the Poisson process that governs the ticks of T and the adjacency 
matrices A(k), k = 1,2,... are independent. Introduce the ordering of links (i, j) G Ed, by attaching a 
distinct number I, / = 1,...,2M, to each link (i,j); symbolically, we write this as / ~ (hj)- Introduce 
now the random variables ((k), k = 1,2, ..., defined as follows: 1) ((k) = i, if the k-th tick of T comes 
from Tf; 2) CO) = N + I, I ~ (i,j), if the fc-th tick of T comes from Tf- and ^-(fc) = 1; and 3) 
£(&) = 0, otherwise. It can be shown that ((k), k = 1,2, ..., are i.i.d. The random variables ((k) define 
the order of events in our communication model. For example, £(1) = N + I, I ~ (z, j), means that, at 
time slot k =1, the virtual node y^ successfully transmitted data to the virtual node j/jj. We remark that 
Prob (((k) = s) is strictly positive, Vs = 0, 1, ..., iV + 2M. This fact will be important when studying 
the convergence of AL-G. 

The communication model in this paper, with static supergraph and link failures, is standard for 
networked systems supported by wireless communication and static (non moving) nodes, see, e.g., [18], 
[19]. The model needs to be modified for scenarios with moving nodes (e.g., mobile robots) where the 
supergraph itself can be time varying. This is not considered here. 

III. AL-G ALGORITHM (AUGMENTED LAGRANGIAN GOSSIPING) 
This section details the AL-G algorithm for solving (1). In subsection III-A, we dualize (2) to form 

the AL dual of problem (2). Subsection IV-B details the D-AL-G algorithm for the dual variable update, 

at a slow time scale; subsection IV-C details P-AL-G to update the primal variables, at a fast time scale. 

A. Dualization 

We form the AL dual of the optimization problem (2) by dualizing all the constraints of the type 

Xi = yij and y^ = yji. The dual variable that corresponds to the constraint x« = yij will be denoted by 

IHi j\, the dual variable that corresponds to the (different) constraint Xj = yji will be denoted by nu a, 

and the one that corresponds to y^ = yji is denoted by A/jj\. In the algorithm implementation, both 

nodes i and j will maintain their own copy of the variable A{j j}-the variable Xuj) at node i and the 

variable Aqj) at node j. Formally, we use both A(jj) and Aqj), and we add the constraint X^j) = A(jj). 

3 With AL-MG algorithm, in Section VI, we will additionally require Aij(k) and Ai m (k) be independent. 
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The term after dualizing y tj = y jh equal to Xjijyiyij - Vji), becomes: ^J^Vij ~ tfj^Vji- Tne resulting 
AL dual function L a (-), the (augmented) Lagrangian L(-), and the AL dual optimization problem are, 
respectively, given in eqns. (3), (4), and (5). 

L « ( { a (m)}> iH*d)} ) = min L (i Xi }' {Wj}. i\ij)h {M(*j)}) 

subject to Xi G Afj, i = 1, ..., N (3) 

!/yet ra , (i,j)£E d 

N 

L ({xi}, {yij}, {\i,j)}, {/i(ij)» = XI /*( x< ) + X ^J,j) ( x * ~ Vv) (4) 

»=i (i,j)e£ d 

+ Yl X h) V*3 ~ X Jj,i) VH + 2 P Y1 H Xi ~ V*i I' 2 + 2 P 2 " yij ~ %i " 2 
{ij}e£,Kj (id)eE d {i,j}eE,i<j 

maximize L a ({A (iJ) }, {a*(j,j)}) 

subject to A (ij -) = A (j)i) , {«, j} eE. (5) 

/iyct™ (i,j)eE d 

In eqn. (4), p is a positive parameter. See [6] for some background on AL methods. The terms A7 ■-, yij — 

X Jj,i) Vji in the sum Y.{i,j}eE X Jij) Vij ~ ^Jj,i) Vji are arranged such that i < j, for all {i, j} G E. 4 

Denote by d* the optimal value of the dual problem (5), the dual of (2). Under Assumption 1, the 
strong duality between (2) and (5) holds, and d* = /*; moreover, the set of optimal solutions V* = 

{{ A (ij)}> irfij)} : L <> (i A *ij)}' Wij)}) = /*} is nonempty. Denote by C := ATi x # 2 x ... x ^ x 
(M)"^ ' the constraint set in (3), i.e., the constraints in (2) that are not dualized. Let xq be a point 
in ri(Afj), i = 1,...,N (see Assumption 1.3.) Then, a point ({xj,o}> {lHjfi}) e C> where Xi,o = Xo, 
Vij ft = xo, belongs to ri(C), and it clearly satisfies all equality constraints in the primal problem (2); 
hence, it is a Slater point, and the above claims on strong duality hold, [15]. We remark that strong 
duality holds for any choice of p > (but we are interested only in the case p > 0,) and, moreover, the 
set of dual solutions V* does not depend on the choice of p, provided that p > (see, e.g., [20], p.359.) 



4 For each link {i,j} G E, the virtual nodes y,j and t/ji (i.e., nodes i and j,) have to agree beforehand (in the network 
training period) which one takes the + sign and which one takes the — sign in AZ ■■> ytj — \J, ^ yji. In eqn. (4), for sake of 
notation simplicity, the distribution of + and — signs at each link {i,j} is realized by the order of node numbers, where a 
distinct number in {1, ..., iV} is assigned to each node. However, what matters is only to assign + to one node (say i) and — 
to the other, for each {i, j} G E. 
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B. Solving the dual: D—AL—G (dual augmented Lagrangian gossiping) algorithm 

We now explain how to solve the dual problem (5). First, we note that (5) is equivalent to the uncon- 
strained maximization of L' a ({X {iJ} },{fi {iJ) }) = mm XieXit y ij€Rm V ({xi}, {y {j }, {X {iJ} }, {M(i,j)})> 
where the function V ({xi},{yij}, {Xuj\}, (M(jj)}) i s defined by replacing both Xuj) and Xqa in 
L(-) (eqn. (4)) with \{ij}, for all {i,j} G E. The standard method of multipliers for the unconstrained 
maximization of L' a (-) is given by: 

\ {i , j} (t + l) = \ {id} (t) + p sign{j - i) {y*j(t) - y*i(t)) , {i,j}£E (6) 

H(ij)(t + 1) = H(i,j){t) + p (x*(t) - ytj{t)) , (i, j) G E d . 



K(*)}, (4WIJ e arg min L' ({x,}, {y^}, {A {iJ} (i)}, {//(„)(*)}) 

subject to Xj G Xi, i = 1, ..., iV (7) 

l/yet" 1 , (i,j)€E d . 

Assigning a copy of A/jj\ to both nodes i (the corresponding copy is Xuj)) and j (the corresponding 
copy is A(j j)), eqn. (6) immediately yields an algorithm to solve (5), given by: 

\i,j)(t + 1) = \i,j)(t) + P sign(j - i) (y^(t) - y*i(t)) , (i,j) G E d (8) 

A*(»J)(* + !) = A«(ij)(*) + P (»*(*) - y*j(*)) . (*> j) € £? d , 
where 



subject to SjG^i, i = l,...,JV (9) 



(Note that f {x*(t)}, {y|j(£)} ) is the same in (7) and (9).) According to eqn. (8), essentially, both nodes 
i and j maintain their own copy (Xuj) and Xqa, respectively) of the same variable, Xuj\. It can be 
shown that, under Assumption 1, any limit point of the sequence \{x*(t)},{y*At)}j, t = 0,1,..., is 
a solution of (2) (see, e.g., [7], Section 3.4); and the corresponding limit point of the sequence x*(t), 
t = 0,1, ..., is a solution of (1). 

Before updating the dual variables as in (8), the nodes need to solve problem (9), with fixed dual 
variables, to get [{x*(t)},{y*j(t)}). We will explain in the next subsection (IV-C), how the P-AL-G 
algorithm solves problem (9) in a distributed, iterative way, at a fast time scale {k}. We remark that 
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P-AL-G terminates after a finite number of iterations k, and thus produces an inexact solution of (9). 
We will see that, after termination of the P-AL-G algorithm, an inexact solution for yji is available at 
node i; denote it by yh(t). Denote, respectively, by xf{t) and yfj{t), the inexact solutions for X{ and 
■ijij at node i, after termination of P-AL-G. Then, the implementable update of the dual variables is: 

\i,j){t + 1) = \ij)(t) + p sign(j - i) (yfjit) - yfi(t)) (10) 

P(i,j)(t + 1) = P(i,j)(t) + P {xf{t) - y[j(t)) ■ 

Note that the "inexact" algorithm in (10) differs from (8) in that it does not guarantee that Xuj\(t) = 
A(jj)(t), due to a finite time termination of P-AL-G. 

C. Solving for (9): P-AL-G algorithm 

Given {\ij){t)}, {pH,j){t)}, we solve the primal problem (9) by a randomized, block-coordinate, 
iterative algorithm, that we refer to as P-AL-G. To simplify notation, we will write only Xuj) and 
f-tuj) instead of Xuj)(i), pu t j\(t). We remark that Xuj^t), puj\(t) stay fixed while the optimization in 
eqn. (9) is done (with respect to Xi, yij.) 

The block-coordinate iterative algorithm works as follows: at time slot k, the function in (4) is 
optimized with respect to a single block-coordinate, either Xi or y^, while other blocks are fixed. Such 
an algorithm for solving (9) admits distributed implementation, as we show next. Minimization of the 
function L ({xi},{yij}, {\i,j)}, {vuj)}) wrtn respect to xu while the other coordinates Xj and y^ are 
fixed, is equivalent to the following problem: 

minimize fi(xi) + fa - pyJ T x { + \pdi\\x,i\\ 2 
subject to Xi £ Xi 

where ~p i = Yljen- ^(hj) anc ^ V% = Y^j^n Vv- Thus, in order to update Xi, the node i needs only 
information from its (virtual) neighbors. Minimization of the function L ({x^}, {yij}, {\i,j)}, {^(ij)}) 
with respect to y^, while the other coordinates Xj and yi m are fixed, is equivalent to: 

minimize pj^ (xi - y^) + A^^sign^' - i) (y^ - y jt ) + \p\\xi - ^|| 2 + \p\\yij - yji\\ 2 
subject to y^ £ W m . 

Thus, in order to update y^, the corresponding virtual node needs only to communicate information with 
its neighbors in the network, yji and Xj. Physical communication is required only with yji (i.e., with 
physical node j.) The optimization problem (12) is an unconstrained problem with convex quadratic cost 
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11 
and admits the closed form solution: 

y%i = ^yji + 2 Xi+ 2p ^ {iJ) ~ sign ^ J ~ *) X{i > j ^ ' < - 13) 

Distributed implementation. We have seen that the block-coordinate updates in eqns. (11) and (13) only 
require neighborhood information at each node. We next give the distributed implementation of P-AL-G 
(see Algorithm 1) using the asynchronous communication model defined in section II. 
Algorithm 1 Algorithm with gossiping for solving (9) (P-AL-G) 



Wait for the tick of one of the clocks Tf, Tf-. 



l: repeat 

2: 

3: If clock Tf- ticks, node i transmits to node j the current value of yij. 

If node j successfully receives j/y, it updates the variable yji according to the equation (13). 
4: If clock Tf ticks, node % updates the variable xi by solving (11). 
5: until a stopping criterion is met. 



1) Simplified notation and an abstract model of the P-AL-G: We now simplify the notation and 
introduce an abstract model for the P-AL-G algorithm, for the purpose of convergence analysis in 
Section IV. Denote, in a unified way, by Zi, the primal variables xi and y^, i.e., zi := Xi, i = 1, ..., N, 
and zi := yij, I = N + 1, ..., N + 2M, (i,j) G Ed- Then, we can write the function in (4), viewed as a 
function of the primal variables, simply as L(z), L : ]^ m ( N +2M) _^ ^ Also, denote in a unified way the 
constraint sets d := X u i = 1, ...,N, and Q := M. m , I = JV + 1, ...,2M + N (Q, I = N + l, ...,N + 2M; 
these sets correspond to the constraints on y^, (i,j) £ Ed-) Finally, define C := C\ x Ci x ... x Cn+2M- 
Thus, the optimizations in (11) and (13) are simply minimizations of L{z) with respect to a single (block) 
coordinate z\, I = 1, ..., 2M + TV. Recall the definition of ((k), k = 1,2, ... in section II. Further, denote 
Pi := Prob (C(k) = i) > 0, i = 0, 1, 2, ..., 2M + N. Then, it is easy to see that the P-AL-G algorithm 

can be formulated as in Algorithm 2. 

Finally, we summarize the overall primal-dual AL-G algorithm in Algorithm 3. 

Algorithm 2 AL-G algorithm at node i 
1 

2 
3 
4 
5 
6 



Set t = 0, \ {iJ) (t = 0) = 0, fi {iJ) (t = 0) = 0, j G iU 
repeat 



Run P-AL-G (cooperatively with the rest of the network) to get xf (£), yf~(t) and yh(t), j G Q.i 
Update the dual variables, \uj\(t), /j,uj\(t), j G ilj, according to eqn. (8). 
Set t «- t + 1 
until a stopping criterion is met. 

Remark. With AL-G, the updates of the primal variables, on a fast time scale k, are asynchronous 
and use gossip communication, while the updates of the dual variables, on a slow time scale t, are 
synchronous and require no communication. Physically, this can be realized as follows. Each (physical) 
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node in the network has a timer, and the timers of different nodes are synchronized. At the beginning 
of each (slow time scale) t-slot, nodes start the gossip communication phase and cooperatively run the 
P-AL-G algorithm. After a certain predetermined time elapsed, nodes stop the communication phase 
and, during an idle communication interval, they update the dual variables. After the idle time elapses, 
the nodes restart the communication phase at the beginning of the new t-slot. 

Choice of p. It is known that, under Assumption 1, the method of multipliers (6) converges (i.e., any 
limit point of the sequence x*(t), t = 0, 1, ..., is a solution of (1)) for any choice of the positive parameter 
p, [21], Theorem 2.1. It converges also if a sequence p t +\ > pt is used, [22], Proposition 4. See [6], 
4.2.2, for a discussion on the choice of p. The method of multipliers still converges if we use different 
parameters p = p(\ (ij) j), p = P( M(lj) ,t), for each of the variables \(ij), P(i,j)- This corresponds to 
replacing the quadratic terms p \\xi — Vij\\ 2 and p \\yij — yji\\ 2 in eqn. (4) with p(„ t \ \\xi — Vij\\ 2 and 
P{na, ih t) \\Vij - Vji\\ 2 > respectively. See reference [23] for details. (We still need P(\ iiJh t) ~ P(\ u , ih t)-) 
Equation (11) becomes 5 

T 



minimize fi( Xi ) + (^ - £ jen . P(\ (i , jh t) Vij) x t + \ (J2jen z P(j*(«,«,t) 
subject to Xi G X% 

and equation (13) becomes 



Ir-ll 2 



(14) 



w = P(> r" — fe +w ,) + " w '" sign(J " i)A '-^ da 

One possibility for adjusting the parameters p^ t \ and p( A t \ in a distributed way is as follows. 
Each node i adjusts (updates) the parameters p(x (tj)t ), P(uu-)t)> 3 ^ ^«- We focus on the parameter 
pr\ t y, other parameters are updated similarly. Suppose that the current time is t. Node i has stored 
in its memory the constraint violation at the previous time t — 1 that equals en -,,t-i) = \\yfj{t ~ 1) — 
Vji{t — 1)||. Node i calculates the constraint violation at the current time e<\ t \ = \\yfj{t) — y^(t)||. 
If e (A (i j) ,t)/ e (A ( , ),t-i) ^ K (A(ij)) < 1' tnen trie constraint violation is sufficiently decreased, and the 
parameter pn t \ remains unchanged, i.e., node i sets p<\ t \ = pt\ .-t-i); otherwise, node i increases 
the parameter, i.e., it sets p(x^ jh t) = 0{\ t , 3) )P{\ t , Jh t-i)- The constants K(a (1iJ) ) G (0, 1) and <r (A( . .,) > 1 
are local to node i. 

5 Reference [23] proves convergence of the method of multipliers with the positive definite matrix (possibly time-varying) 
penalty update, see eqn. (1.5) in [23]; the case of different (possibly time- varying) penalties assigned to different constraints is 
a special case of the matrix penalty, when the matrix is diagonal (possibly time-varying.) 
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IV. Convergence analysis of the AL-G algorithm 

This section provides the convergence of the AL-G algorithm. Convergence of the multiplier method 
for the dual variable updates (on slow time scale {£}) in eqn. (8) is available in the literature, e.g., [6]. 
We remark that, in practice, P-AL-G runs for a finite time, producing an inexact solution of (9). This, 
however, does not violate the convergence of the overall primal-dual AL-G scheme, as corroborated by 
simulations in Section VI. The P-AL-G algorithm for the primal variable update (on the fast time scale 
{k}) is novel, and its convergence requires a novel proof. We proceed with the convergence analysis of 
P-AL-G. First, we state an additional assumption on the function /(•), and we state Theorem 4 on the 
almost sure convergence of P-AL-G. 

Assumptions and statement of the result. Recall the equivalent definition of the P-AL-G and the 
simplified notation in III-C1. The P-AL-G algorithm solves the following optimization problem: 

minimize L(z) 

(16) 
subject to z £ C 

We will impose an additional, mild assumption on the function L{z), and, consequently, on the function 
/(•). First, we give the definition of a block-optimal point. 

Definition 2 (Block-optimal point) A point z* = {z\,z*, ■■■■>z* n+2 m) * s block-optimal for the prob- 
lem (16) if: z\ S &Tgmm w . eC .L (zl, z', ..., z'^Wi, z' +1 , ..., z' N+2M ) , i = 1,...,N + 2M. 

Assumption 3 If a point z* is a block-optimal point of (16), then it is also a solution of (16). 

Remark. Assumption 3 is mild: it is valid if, e.g., fi(x) = fci||a;||i + Wj(a;), kj > 0, where W{ : M. m — > M. 
is a continuously differentiable, convex function, and ||x||i = 2~2i=i l x *l * s tne 'i norm of x, [24]. 

Define the set of optimal solutions B = {z* G C : L(z*) = L*}, where L* = inf zG c*L(z). 6 Further, 
denote by dist(6, A) the Euclidean distance of point b G IR m to the set A C W 71 , i.e., dist(6, A) = 
inf a6j 4 \\a — &||2, where ||x||2 is the Euclidean, I2 norm. We now state the Theorem on almost sure (a.s.) 
convergence of the P-AL-G algorithm (Theorem 4,) after which we give some auxiliary Lemmas needed 
to prove Theorem 4. 

Theorem 4 Let Assumptions 1 and 3 hold, and consider the optimization problem (16) (with fixed dual 
variables.) Consider the sequence {z(k)}^ =0 generated by the algorithm P-AL-G. Then: 

6 Under Assumption 1, the set B is nonempty and compact and L* > —00. This will be shown in Lemma 5. Clearly, 
L* — L* ({A(jj)},{/U(jj)}) and B = B ({\(ij)}, {M(i,j)}) depend on the dual variables. For simplicity, we write only L* 
and B. 
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1) limfc-Kx, dist (z(k),B) = 0, a.s. 

2) lim^oo L (z(k)) = L*, a.s. 

Auxiliary Lemmas. Let %c ■ M. m -s-RU {+00} be the indicator function of the set C, i.e., ic(z) = if 
z £ C and +00 otherwise. It will be useful to define the function L + i c : ]R m ( iV + 2M ) -> R u {+00}, 
(L + ic)(z) = £(z) + ic{z)- Thus, the optimization problem (16) is equivalent to the unconstrained 
minimization of (L + ic){')- The following Lemma establishes properties of the set of solutions B, the 
optimal value L*, and the function (L + ic){')- 

Lemma 5 Let Assumption 1 hold. The functions L(z) and (L + ic)(z) are coercive, L* > —00, and the 
set B is nonempty and compact. 

Proof: The function L(z) (given in eqn. (4)) is coercive. To see this, consider an arbitrary sequence 
{z(j)} ( ^ =1 , where ||z(j)|| — > 00 as j — > 00. We must show that L(z(j)) — > 00. Consider two possible 
cases: 1) there is i G {l,...,iV} such that ||xj(j)|| — > 00; and 2) there is no i G {l,...,iV} such 
that ||xj(j)|| — > 00. For case 1), pick an % such that ||xj(j')|| — > 00; then fi(xi(j)) — > 00, and hence, 
L{z{j)) — > 00. In case 2), there exists a pair (i,l) such that ||y^|| — > 00; but then, as Xi(j) is bounded, 
we have that ||xj(j) — y^(i)|| 2 — > 00, and hence, L(z(j)) — > 00. The function (L + ic)(z) is coercive 
because (L + ic){z) > ^(^)> V- 2 ' an d -^(-z) is coercive. The function (L + icX^) is a closed 7 (convex) 
function, because L(z) is clearly a closed function and ic{z) is a closed function because C is a closed 
set; hence, (L + ic){z) is closed function as a sum of two closed functions.Hence, B is a closed set, as 
a sublevel set of the closed function (L + ic){z). The set B is bounded as a sublevel set of a coercive 
function (L + ic)(z). Hence, B is closed and bounded, and thus, compact. We have that L* > — 00 (and 
B is non empty) as L(z) is a continuous, convex, and coercive on ]& m ( N + 2M ) _ ■ 

Define U e (B) = {z : dist(z, B) < e}, and let V e (B) be its complement, i.e., V e {B) = W n \U e (B). Further, 
denote by S and F the initial sublevel sets of L and L + ic, respectively, i.e., S = {z : L(z) < L(z(0))}, 
and F = {z : (L + ic){z) < L(z(0))} = S D C, where z(0) G C is a feasible, deterministic, initial 
point. We remark that, given z(0), any realization of the sequence {z(k)}^ =0 stays inside the set F. 
This is true because L{z{k)) is a nonincreasing sequence by the definition of the algorithm P-AL-G 
and because any point z(k) is feasible. Define also the set T(e) = Ffl V € (B). We now remark that, by 
construction of the P-AL-G algorithm, the sequence of iterates z(k) generated by P-AL-G is a Markov 
sequence. We are interested in the expected decrease of the function L(-) in one algorithm step, given 

7 A function q : K m ->IU {+00} is closed if its epigraph cpi(q) = {(a;, v) : q{x) < v} is a closed subset of K m+1 . 
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that the current point is equal to z(k) = z: 

i){z) = E [L (z{k + 1)) \z(k) = z\- L(z). (17) 

Denote by L l (z) the block-optimal value of the function L(z) after minimization with respect to zf. 

L % (z)= min L(zi,Z2,...,Zi-i,Wi,z i+1 ,...,z N +2M) (18) 

Wi£Ci 

We have, by the definition of P-AL-G, that (recall the definition of Pi above Algorithm 2:) 

N+2M 

4,(z) = J2 ^{L l {z)-L{z)). (19) 

i=i 

Define <f)(z) = —tp(z). From eqn. (19), it can be seen that <f)(z) > 0, for any z G C. We will show that 

4>{z) is strictly positive on the set T(e) for any positive e. 



Lemma 6 



inf <f,(z) = o(e) > (20) 

26 r( e ) 



We first show that T(e) is compact and that D is continuous on T(e) (latter proof is in the Appendix.) 

Lemma 7 (Compactness of I\e)) The set T(e) is compact, for all e > 0. 

Proof: We must show that T(e) is closed and bounded. It is closed because it is the intersection of 
the closed sets F and V e (B). It is bounded because T(e) C F, and F is bounded. The set F is bounded 
as a sublevel set of the coercive function L + %c- The set F is closed as a sublevel set of the closed 
function L + iq. ■ 

Lemma 8 (Continuity of L 1 ) The function L l : T(e) — > M is continuous, i = 1, ..., iV + 2M. 

Proof of Lemma 6: First, we show that <^(z) > 0, for all z G T(e). Suppose not. Then, we have: 
L l (z) = L(z), for all i. This means that the point z G T(e) is block-optimal; Then, by Assumption 3, the 
point z is an optimal solution of (16). This is a contradiction and 4>{z) > 0, for all z G T(e). Consider 
the infimum in eqn. (20). The infimum is over the compact set and the function <fi(-) is continuous (as a 
scaled sum of continuous functions L l {-))\ thus, by the Weierstrass theorem, the infimum is attained for 
some z* G T(e) and <p(z') = o(e) > 0. ■ 

Proof of Theorem 4-1. Recall the expected decrease of the function L(-), ip(z). We have: 

E [Y> (z(k))] = E [E [L (z(k + 1)) \z(k)] - L (z(k))} =E[L (z(k + 1))] - E [L {z{k))\ . (21) 
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On the other hand, we have that E [ip(z(k))] equals: 

E [ip (z(k)) \z(k) G r(e)] Prob (z(k) G T(e)) + E [-0 (z{k)) \z(k) <£ T(e)] Prob (z(k) <£ F(e)) . (22) 

Denote by p k = Prob (z{k) G T(e)). Since tp (z(k)) < -a(e), for z(/c) G T(e), and ip (z(k)) < 0, for 

any z(k), we have that: E [ip (z(k))] = E [L(z(k + 1))] — E[L(z(fc))] < —a(e)pk] summing up latter 

inequality for j = up to j = k — 1, we get: 

fc-i 
E [L(z(fc))] - L(z(0)) < -a(e) J> fc , Vj > 0. (23) 

The last inequality implies that: X^o^fc — ^TiT (^( z (0)) — ^*) < °°- Thus, by the first Borel- 
Cantelli Lemma, Prob (z(k) G T(e), infinitely often) = 0, Ve > 0. Thus, Prob (A) = 1, Ve > 0, 
where the event A e is: A t := {the tail of the sequence z(k) belongs to U e (B)}. Consider the event 
A := n^ 1 ^le s , where e s is a decreasing sequence, converging to 0. Then, Prob (A) = Prob (n^^J = 
lims^oo Prob (A €s ) = lim s ^oo 1 = 1. Now, the event B := {lim^^oo dist(z(fe), B) = 0} is equal to A, 
and thus Prob (B) = 1. 

Expected number of iterations for convergence: Proof of Theorem 4-2. Consider now the sets 
U e {B) = {z : L(z) <e + L*} and V e (B) = R m \U e (B) and define the sets T and Q{e) as T = C n S 
and Q(e) = F C\ V e {B). Similarly as in Lemmas 8, we can obtain that 

inf <f>(z) = 6(e) > 0. (24) 

zeg(e) 

We remark that, once z(k) enters the set U e {B) at k = K e , it never leaves this set, i.e., z{k) G U e {B), 
for all k > K € . Of course, the integer K € is random. In the next Theorem, we provide an upper bound on 
the expected value of K € (the time slot when z(k) enters the set U £ (B),) thus giving a stopping criterion 
(in certain sense) of the algorithm P-AL-G. 

Theorem 9 ( Expected number of iterations for convergence ) Consider the sequence {^(A;)}^ = g gener- 
ated by the algorithm P-AL-G. Then, we have: 

L(z(0))-L* 

E[iq - — W) — • ( } 

Proof: Let us define an auxiliary sequence z(k) as z(k) = z(k), if z(k) G (7(e), and z{k) = z*, 
if z(k) G U € (B). Here z* is a point in B. That is, z(k) is identical to z(k) all the time while z(k) is 
outside the set U e (B) and z(k) becomes z* and remains equal to z* once z(k) enters U e {B). (Remark 
that z(k) never leaves the set U e (B) once it enters it by construction of Algorithm P-AL-G.) 
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Now, we have that: 

, r~ru^ \ ^ z{k)) ~ " 6(e) if z{k) G g(e) 
ip (z(k)) = < . (26) 

I if z(k) G U e (B) 

Taking the expectation of ip (z(k)), k = 0, ...,£ — 1 and summing up these expectations, and letting 
t — > oo, we get: 

oo oo 

E [L (J(oo))] - L(z(0)) = J2 E ty> (z(fc + 1))] -Ety (!(*))] = E £ ^ (z(*0) < -E [tf e ] 6(e) 

fe=0 fc=0 

Thus, the claim in equation (25) follows. ■ 

We now prove Theorem 4—2. By Theorem 10, the expected value of K e is finite, and thus K e is finite 
a.s. This means that for all e > 0, there exists random number K e (a.s. finite), such that z(k) = z*, for 
all k > K e , i.e., such that z(k) G U e {B) for all k > K € . The last statement is equivalent to Theorem 4—2. 

V. Variants to AL-G: AL-MG (augmented Lagrangian multi neighbor gossiping) and 
AL-BG (augmented Lagrangian broadcast gossiping) algorithms 

This section introduces two variants to the AL-G algorithm, the AL-MG (augmented Lagrangian 
multi neighbor gossiping) and the AL-BG (augmented Lagrangian broadcast gossiping). Relying on 
the previous description and analysis of the AL-G algorithm, this section explains specificities of the 
AL-MG and AL-BG algorithms. Subsection V-A details the AL-MG, and subsection V-B details the 
AL-BG algorithm. Proofs of the convergence for P-AL-MG and P-AL-BG are in the Appendix. 

A. AL-MG algorithm 

The AL-MG algorithm is a variation of the AL-G algorithm. The algorithms AL-G and AL-MG 

are based on the same reformulation of (1) (eqn.(2)), and they have the same dual variable update (that 
is, D-AL-G and D-AL-MG are the same.) We proceed by detailing the difference between P-AL-MG 
and P-AL-G to solve (9) (with fixed dual variables.) With the algorithm P-AL-MG, each node has 
two independent Poisson clocks, Tf and if. Update followed by a tick of Tf is the same as with 
P-AL-G (see Algorithm 1, step 4.) If Tf ticks, then node i transmits simultaneously the variables yij, 
j € Oj, to all its neighbors (yij 1 is transmitted to node j±, y,ij 2 is transmitted to node J2, etc.) Due to 
link failures, the neighborhood nodes may or may not receive the transmitted information. Successfull 
transmissions are followed by updates of j/jj's, according to eqn. (13). Define also the virtual clock T 
that ticks whenever one of the clocks Tf, Tf ', ticks. Accordingly, we define the A;-time slots as [r^-i, r^), 
k = 1,2..., ro = 0, and r^ is the time of the fc-th tick of T. Overall AL-MG algorithm is the same 
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as AL-G (see Algorithm 3,) except that, instead of P-AL-G, nodes run P-AL-MG algorithms at each 
t. We prove convergence of the P-AL-MG in the Appendix; for convergence of the overall AL-MG 
algorithm, see discussion at the beginning of section V. 

B. AL-BG algorithm: An algorithm for static networks 

We now present a simplified algorithm for the networks with reliable transmissions. This algorithm is 
based on the reformulation of (1) that eliminates the variables yi/s. That is, we start with the following 
equivalent formulation of (1): 

minimize Y,iLifi( x i) 

subject to Xi G Xi, i = 1, ..., N, (27) 

Xi = Xj, {i,j} G E 

We remark that (27) is equivalent to (1) because the supergraph is connected. After dualizing the 
constraints x\ = Xj, (i,j) G E, the AL dual function L a {-) and the Lagrangian L(-) become: 

L " (i X {i,j}}) = min L (i X i}' i X {i,J}}) 

subject to Xi G Xi, i = 1, ..., N 

N 1 

L{{xi}, {\{ij}}) =^2fi(xi)+ Y^ X Ji,j} & - x i) + 7, P ^ Wxi-Xjf. (28) 

i=1 {i,j}£E,i<j {i,j}£E,i<j 



J\ 



In the sums E{jj} S e x Jij} ( x i ~ x j) and E{jj}se Hxj-XjH 2 , the terms A { T . J} (xi - Xj) and \\x 

are included once. (The summation is over the undirected edges {i, j}.) Also, terms AX .-. (xi — Xj) in 

the sum J2u j\ e E X Ji j} ( x i ~ x j) are arranged such that i < j, for all {i, j} G E. The resulting dual 

optimization problem is the unconstrained maximization of L a (Xujy). 

Solving the dual: D-AL-BG algorithm. We solve the dual (28) by the method of multipliers, which 

can be shown to have the following form: 

\ {lJ} (t + 1) = \ {iJ} (t) + psign(j - i) (x*(t) - x*(t)) (29) 



x*(t) = {x<[(t),xZ(t),...,x* N (t)) G arg min L({ Xi }, {\ {iJ} (t)}) 

subject to Xi G Xi, i = 1, ...,N 

We will explain in the next paragraph how the P-AL-BG algorithm solves (30) in a distributed, iter- 
ative way. With AL-BG, each node needs to maintain only one m-dimensional dual variable: Aj := 
X^en sign(j — i) \{ij}- Also, define Xi := YljeCi x r ^ ne P-AL-G algorithm terminates after a finite 
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number of inner iterations k, producing an inexact solution. Denote by xf (resp. xf) the inexact solution 
of Xi (resp. Xj, j G Oj), available at node i, after termination of P-AL-BG. We will see that xf = xf, 
Vz; accordingly, after termination of P-AL-BG, node % has available xf := J2jeQ x f- Summing up 
equations (29) for A{j j\, j G Oj, and taking into account the finite time termination of the P-AL-BG, 
we arrive at the following dual variable update at node i: 

Xi(t + 1) = Mt) + P {di xf(t) - xf{tj) ,i = l, ..., N. (31) 

Solving for (30): P-AL-BG algorithm. We solve the problem (30) by a randomized, block-coordinate 
P-AL-BG algorithm. After straightforward calculations, it can be shown that minimization of the function 
in (28) with respect to xi (while other coordinates are fixed) is equivalent to the following minimization: 

minimize fi(xi) + (A* - pXi) x t + \pdi\\xi\\ 2 
subject to Xi G Xi 

Similarly as with AL-G, we assume that the clock ticks at all nodes are governed by independent 
Poisson process Tj's. P-AL-BG is as follows. Whenever clock Tj ticks, node i updates Xj via eqn. (32) 
and broadcasts the updated Xi to all the neighbors in the network. Discrete random iterations {k} of the 
P-AL-BG algorithm are defined as ticks of the virtual clock T that ticks whenever one of Tj ticks. The 
P-AL-BG algorithm produces xf and xf at node i. Overall primal-dual AL-BG algorithm is similar 
to the AL-G algorithm (see Algorithm 3), except that, at each t, nodes cooperatively run the P-AL- 
BG algorithm, instead of P-AL-G algorithm. We prove convergence of P-AL-BG in the Appendix; for 
convergence of the overall primal-dual AL-BG scheme, see discussion at the beginning of Section V. 

VI. Simulation examples 

In this section, we consider two simulation examples, namely, ^-regularized logistic regression for 
classification (subsection VI-A,) and cooperative spectrum sensing for cognitive radio networks (subsec- 
tion VI-B.) Both examples corroborate the convergence of our algorithms AL-G, AL-MG on random 
networks, and AL-BG on static networks, and demonstrate tradeoffs that our algorithms show with 
respect to the existing literature. We compare the convergence speed of our and existing algorithms with 
respect to: 1) communication cost; and 2) computational cost, while the communication cost is dominant 
in networked systems supported by wireless communication. AL-BG outperforms existing algorithms 
(in [10], [8], [25], [4] 8 ) on static networks in terms of communication cost, on both examples; at the same 
time, it has a larger computational cost. For the ^-regularized logistic regression example and random 

8 Reference [4] focusses specifically on the Lasso problem; we compare with [4] in subsection VI-B. 
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networks, AL-G and AL-MG outperform existing algorithms ([10], [8] 9 ) in terms of communication 
cost, while having larger computational cost. For the cooperative spectrum sensing example and random 
networks, AL-G and AL-MG converge slower than existing algorithms [10], [8]. 

A. l\- regularized logistic regression for classification 

We consider distributed learning of a linear discriminant function. In particular, we consider the l±- 
regularized logistic regression optimization problem (eqn. (45) in [14]; see Subsections 7.1 and 10.2). 
We add private constraints and adapt the notation from [14] to fit our exposition. 10 The problem setup 
is as follows. Each node i, i = 1,...,N, has Nj data samples, {a^, b^} . = f 1 , where a^ G M. m is a 
feature vector (data vector,) and bij G {—1, +1} is the class label of the feature vector a%j. That is, when 
bij = 1 (respectively, —1,) then the feature vector a^ belongs to the class "1" (respectively, "—1".) The 
goal is to learn the weight vector w € R m , and the offset v € M., based on the available samples at 



,N d 



I 



all nodes, {(%•, hj}-^, i = 1, ..., N, so that w is sparse, and the equality: sign ( a-jW + v J = bij, 
1, ..., N, j = 1, ..., Nd, holds for the maximal possible number of data samples {a^, bij}-^, i = 1, ..., N. 
One approach to choose w and v is via ^-regularized logistic regression; that is, choose w* and v* that 
solve the following optimization problem, [14]: 

minimize Ya=i Y!j=i 1o § f 1 + ex P [- b ij( a Jj w + v ))) + ^IIHIi 

subject to w T w < ki, i = 1, ...,N ■ (33) 

\v\<k' i ,i = l,...,N 

The parameter A > enforces the sparsity in w, [26]. The private constraints on w and v at node i (fcj's 
and fc^'s are positive) represent the prior knowledge available at node i (see [27], Chapter 7.) Problem (33) 
clearly fits our generic framework in (1) and has a vector optimization variable, a non smooth objective 
function, and quadratic private constraints. Alternatives to (33) to learn w and v include support vector 
machines and boosting, [26], [14]. 

Simulation setup. We consider a supergraph with N = 20 nodes and \E\ = 37 undirected edges (74 
arcs). Nodes are uniformly distributed on a unit square and pairs of nodes with distance smaller than 
a radius r are connected by an edge. For networks with link failures, the link failures of different 

arcs at the same time slot are independent and the failures of the same arc at different time slots are 

s 2 
independent also. Link failure probabilities irij are generated as follows: -k^ = kji, 5ij < r, where 



'Only references [10], [8] consider random networks 

10 Note that [14] studies only the parallel network arc 
solve the Zi-regularized logistic regression problem on generic networks, the case that we address here 



10 Note that [14] studies only the parallel network architecture, with a fusion center, and it does not propose an algorithm to 
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k = 0.5. Each node has N^ = 5 data samples. Each feature vector a^ 6 IR"\ m = 20, and the "true" 
vector Wtruc have approximately 60% zero entries. Nonzero entries of aij and iutrue> and the offset v trU c 
are generated independently, from the standard normal distribution. Class labels fry are generated by: 
bij = sign ( a^Wtrue + ^tme + e?j ) . where e^ comes from the normal distribution with zero mean and 
variance 0.1. The penalty parameter A is set to be 0.5 • A max , where A max is the maximal value of A 
above which the solution to (33) is w* = (see ([14], subsection 10.2) how to find A max .) We set ki 
and k' ri as follows. We solve the unconstrained version of (33) via the centralized subgradient algorithm; 
we denote the corresponding solution by w* and v*. We set ki = (1 + Ti) • \\w*\\ 2 , k\ = (1 + r£) • \v'\, 
where n and r' { are drawn from the uniform distribution on [0, 1]. Thus, the solution to problem (33) is 
in the interior of the constraint set. (Similar numerical results to the ones presented are obtained when 
the solution is at the boundary.) To update Xi with P-AL-G and P-AL-MG (eqn. (11)), we solve (11) 
via the projected subgradient algorithm. 

Algorithms that we compare with. In the first set of experiments, we consider AL-BG for (static) 
networks; in the second set of experiments, we test AL-G and AL-MG on networks with link failures. 
We compare our algorithms with the ones proposed in [10], [11], [9], [8] 11 and in [25]. References [10], 
[11], [9], [8] propose a primal projected subgradient algorithm, here refer to as PS (Primal Subgradient.) 
PS, as an intermediate step, computes weighted average of the optimal point estimates across node i's 
neighborhood. Averaging weights have not been recommended in [10], [11], [9], [8]; we use the standard 
time-varying Metropolis weights, see [28], eqn. (11). Reference [25] proposes an incremental primal 
subgradient algorithm, here referred to as MCS (Markov chain subgradient.) With MCS, the order of 
incremental updates is guided by a Markov chain, [25]. 12 We simulate MCS and PS with fixed subgradient 
step size rather than the diminishing step size, as the former yields faster convergence. 

We compare the algorithms based on two criteria. The first is the amount of inter-neighbor com- 
munication that the algorithms require to meet a certain accuracy. We count the total number of radio 
transmissions (counting both successful and unsuccessful transmissions.) The second is the total number 
of floating point operations (at all nodes.) In networked systems supported by wireless communication 
(e.g., WSNs,) the dominant cost (e.g., power consumption) is induced by communication. Total number 
of floating point operations depends on the algorithm implementation, but the results to be presented give 
a good estimate of the algorithms' computational cost. It may be possible to reduce the computational 

"We simulate the algorithms in [10], [11], [9], [8] with symmetric link failures. 

12 Convergence for MCS has been proved only with the projection onto a public constraint set, but we simulate it here with 
the straightforward generalization of the projection onto private constraint sets; MCS showed convergence for our example in 
the private constraints case also. 
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cost of AL-G, AL-MG, and AL-BG by a more computationally efficient solutions to problems (11) 
and (32) than (here adopted) projected subgradient method. 

Denote by /* the optimal value of (33). We compare the algorithms in terms of the following metric: 

N 

N 



crr J - 7i E (/(**) - r 



1=1 
where Xi is the estimate of the optimal solution available at node % at a certain time. 

With our AL-G, AL-MG, and AL-BG algorithms, the simulations to be presented use an increasing 
sequence of AL penalty parameters (see the end of Section IV,) which, after some experimentation, we set 
to the following values: p t = t Ap + B p , t = 0, 1, ..., with A p = 1.3, and B p = 1. We also implemented 
the algorithms with different and increasing p's assigned to each dual variable, with the scheme for 
adjusting p's explained at the end of Section IV, with K\. f ^ = K P(t j} = 0.3, and <J\ { .. } = o"^ (ij) = 1.2. 
The latter choice also showed convergence of AL-G, AL-MG, and AL-BG, but the former yielded 
faster convergence. Our simulation experience shows that the convergence speed of AL-G, AL-MG, 
and AL-BG depend on the choice of pt, but the optimal tuning of p t is left for future studies. With PS 
and MCS, and a fixed step size, the estimates f(x{) converge only to a neighborhood of /*. There is a 
tradeoff between the limiting error errj(oo) and the rate of convergence with respect to the stepsize a: 
larger a leads to faster convergence and larger err^(oo). We notice by simulation that AL-G, AL-MG, 
and AL-BG converge to a plateau neighborhood of /*; after that, they improve slowly; call the error 
that corresponds to this plateau errj(ss). To make the comparison fair or in favor of PS and MCS, we 
set a for the PS and MCS algorithms such that the errj(oc) for PS and MCS is equal (or greater) than 
the err(ss) attained by AL-G, AL-MG, and AL-BG. 

Results: Static network. Figure 2 (top left) plots err^ versus the number of (m = 20-dimensional vector) 
transmissions (cumulatively at all nodes.) We can see that AL-BG outperforms PS and MCS by one to 
two orders of magnitude. AL-BG needs about 0.3 • 10 5 transmissions to reduce errj below 0.001, while 
MCS and PS need, respectively, about 4 • 10 5 and 18 • 10 5 transmissions for the same precision. With 
respect to the number of floating point operations (Figure 2, top right,) AL-BG needs more operations 
than MCS and PS; 45 • 10 8 for AL-BG versus 13 • 10 8 for PS, and 2 • 10 8 for MCS. Thus, with respect 
to MCS, AL-BG reduces communication at a cost of additional computation. Note that with AL-BG, 
MCS, and PS, due to private constraints, node i's estimate x% may not be feasible at certain time slots; 
in this numerical example, AL-BG, MCS, and PS all produced feasible solutions at any time slot, at all 
nodes. A drawback of MCS in certain applications, with respect to PS and AL-BG, can be the delay 
time that MCS needs for the "token" to be passed from node to node as MCS evolves, see [25]. 
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Results: Random network. Figure 2 (bottom left) plots errj versus the total number of transmissions. 
AL-MG and AL-G outperform PS. To decrease err^ below 5 • 10 -4 , AL-MG and AL-G require about 
1.2 • 10 6 transmissions, and AL-G 1.5 • 10 6 transmissions; PS requires about 3.7 • 10 6 transmissions to 
achieve the same precision. Figure 2 (bottom right) plots errj plots versus the total number of floating 
point operations. PS requires less computation than AL-G and AL-MG. To decrease errj below 5- 10 -4 , 
AL-MG and AL-G require about 69 • 10 9 transmissions; PS requires about 2.8 • 10 9 transmissions for 
same precision. With each of the algorithms AL-G, AL-MG, and PS, each node i's estimate Xi was 
feasible along time slots. 




number of transmissions 



2 4 6 

number of floating point operations x -| q 10 



Fig. 2. Performance of AL-BG, MCS, and PS on a static network (top figures,) and the AL-G, AL-MG and PS algorithms 
on a random network (bottom figures.) Left: total number of transmissions; Right: total number of floating point operations. 

B. Cooperative spectrum sensing for cognitive radio networks 

We now consider cooperative spectrum sensing for cognitive radio networks. Cognitive radios are an 
emerging technology for improving the efficiency of usage of the radio spectrum. (For a tutorial on 
cognitive radios see, e.g., [29].) We focus here on the cooperative spectrum sensing approach that has 
been studied in [4], [3]. Suppose that N r cognitive radios, located at x r positions in 2D space, cooperate to 
determine: 1) the spatial locations; and 2) the power spectrum density (PSD) of primary users. Primary 
users can be located on N s potential locations, x s , on y/Ng x \/N^ square grid (See Figure 3, top, 
in [3].) For brevity, we omit the details of the problem setup; we refer to reference [4], subsection II- 
A, for the problem setup, and section II (eqn. (2)) in the same reference, for the Lasso optimization 
problem of estimating the locations and the PSD of primary users. This (unconstrained) optimization 
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problem in eqn. (2) in [4] fits the generic framework in eqn. (1); thus, our algorithms AL-G, AL-MG 

and AL-BG apply to solve the problem in eqn. (2) in [4]. Throughout, we use the same terminology 

and notation as in [4]. We now detail the simulation parameters. The number of potential sources is 

N s = 25; they are distributed on a regular 5x5 grid over the square surface of 4km 2 . Channel gains 

7 sr are modeled as j sr = mini 1, T] — — l|a >, with A = 200 [meters] and a-3. The number of basis 

rectangles is Nb = 6, and the number of frequencies at which cognitive radios sample PSD is Nf = 6. 

There are 3 active sources; each source transmits at 2 out of Nb = 6 possible frequency bands. After 

some experimentation, we set the Lasso parameter A (see eqn. (2) in [4]) to A = 1; for a distributed 

algorithm to optimally set A, see [4]. We consider the supergraph with N r = 20 nodes (cognitive radios) 

and \E\ = 46 undirected edges (92 arcs.) Nodes are uniformly distributed on a unit 2kmx2km square 

and the pairs of nodes with distance smaller than r =750m are connected. 

For static networks, we compare AL-BG (our algorithm) with MCS, PS, and an algorithm in [4]. 

Reference [4] proposes three (variants of AD-MoM type algorithms, mutually differing in: 1) the total 

number of primal and dual variables maintained by each node (cognitive radio); 2) the method by which 

nodes solve local optimizations for primal variable update (These problems are similar to (32).) We 

compare AL-BG with the DCD-Lasso variant, because it has the same number of primal and dual 

variables as AL-BG and a smaller computational cost than the alternative DQP-Lasso variant. With 

AL-BG, we use an increasing sequence of AL penalty parameters, p t = K p A 1 + C p , t = 0, 1, ..., with 

K p = 1, A p = 1.15 and C p = 3. With DCD-Lasso, we used fixed p = p t , as in [4], [3]. 13 We solve the 

local problems in AL-BG (eqn. (32)), AL-G and AL-MG (eqn. (11),) by an efficient block coordinate 

method in [4] (see eqn. (13) in [4].) For the networks with link failures, we have compared our AL-G 

and AL-MG algorithms with PS (in [10], [11], [9], [8].) We briefly comment on the results. Both AL-G 

and AL-MG converge to a solution, in the presence of link failures as in VI-A; they converge slower 

than the PS algorithm, both in terms of communication and computational cost. 

Results for static network. Figure 3 (left) plots errj for PS, MCS, DCD-Lasso, and AL-BG versus the 

number of transmissions (at all nodes.) AL-BG shows improvement over the other algorithms. To achieve 

the precision of errj < 0.044, AL-BG requires about 5 • 10 4 transmissions; MCS 20 • 10 4 transmissions; 

DCD-Lasso 25 • 10 4 transmissions; PS 50 • 10 4 transmissions. Limiting error for PS is 0.027 (not visible 

in the plot.) Note also that DCD-Lasso and PS saturate at a larger error than AL-BG and MCS. Figure 
3 (right) plots the errj for the PS, MCS, DCD-Lasso, and AL-BG algorithms versus the total number of 

13 It may be possible to improve on the speed of DCD-Lasso by selecting appropriate time varying p — p t ; this is outside of 
our paper's scope. 
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Fig. 3. Performance of AL-BG, DCD-Lasso, PS and MCS algorithms on static CR network. Left: total number of transmissions 
(cumulatively, at all nodes). Right: total number of floating point operations (cumulatively, at all nodes.) 



floating point operations. AL-BG, MCS and DCD-Lasso show similar performance, while PS is slower. 

VII. Conclusion 

We studied cooperative optimization in networked systems, where each node obtains an optimal (scalar 
or vector) parameter of common interest, x = x*. Quantity x* is a solution to the optimization problem 
where the objective is the sum of private convex objectives at each node, and each node has a private 
convex constraint on x. Nodes utilize gossip to communicate through a generic connected network with 
failing links. To solve this network problem, we proposed a novel distributed, decentralized algorithm, 
the AL-G algorithm. AL-G handles a very general optimization problem with private costs, private 
constraints, random networks, asymmetric link failures, and gossip communication. 

This contrasts with existing augmented Lagrangian primal-dual methods that handle only static net- 
works and synchronous communication, while, as mentioned, the AL-G algorithm handles random 
networks and uses gossip communication. In distinction with existing primal subgradient algorithms 
that essentially handle only symmetric link failures, AL-G handles asymmetric link failures. 

AL-G updates the dual variables synchronously via a standard method of multipliers, and it updates 
the primal variables via a novel algorithm with gossip communication, the P-AL-G algorithm. P-AL-G 
is a nonlinear Gauss-Seidel type algorithm with random order of minimizations. Nonlinear Gauss-Seidel 
was previously shown to converge only under the cyclic or the essentially cyclic rules, [24], [6]; we 
prove convergence of P-AL-G, which has a random minimization order. Moreover, our proof is different 
from standard proofs for nonlinear Gauss-Seidel, as it uses as main argument the expected decrease in 
the objective function after one Gauss-Seidel step. We studied and proved convergence of two variants 
of AL-G, namely, AL-MG and AL-BG. An interesting future research direction is to develop a fully 
asynchronous primal-dual algorithm that updates both the dual and primal variables asynchronously. 
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The AL-G algorithm is a generic tool to solve a wide range of problems in networked systems; 
two simulation examples, ^-regularized logistic regression for classification, and cooperative spectrum 
sensing for cognitive radios, demonstrated the applicability and effectiveness of AL-G in applications. 

Appendix 
Proof of Lemma 8. We first need a standard result from topology (proof omitted for brevity.) 

Lemma 10 Let X and y be topological spaces, where y is compact. Suppose the function: k : X x y — > M. 
is continuous (with respect to the product topology on X x y and the usual topology on R; x denotes 
Cartesian product.) Then, the function 7 : X — > M., 7(a) := inf{/t(a, b) : b £ y} is continuous. 

Proof of Lemma 8: Denote by Vi : R™( N + 2M ) -». R m the projection map Ti(z) = zt,i = 1, ..., N+ 

2M. Further, denote by Vi{T(e)) :={zi G R m : z t = Pi(z), for some z g T(e)}. The set Vi{T(e)) is 

compact, for all i = 1, ..., N + 2M, because the set T(e) is compact. Consider now the set R m ( N + 2M ) 3 

C e := V\ (r(e)) x "^(iXe)) x ... x 7 3 7v+2M(r(e)), where the symbol x denotes the Cartesian product 

of the sets. Clearly, C e D T £ (B). We will show that L % is continuous on C e , i.e., that L l : C e — > 

M. is continuous, which will imply the claim of Lemma 8. Recall the definition of L l in eqn. (18). 

It is easy to see that the minimum in eqn. (18) is attained on the set V% (T(e)), i.e., that L l {z) = 

mm w . e -p.r T u\\L(zi,Z2,---,Zi-i,Wi,Zi+i,...,ZN+2M)- Thus, by Lemma 12, and because the function 

L : W n ( N+2M 1 ->• R is continuous, the function U : Vi(T(e)) x ... x Vi-i(T(e)) x V i+ i(F(e)) x ... x 

'Pn+2m{^{()) — > K is continuous. But this means that L % : C e — > K is also continuous. ■ 

Convergence proof of the P-AL-MG algorithm. We first introduce an abstract model of the P-AL- 

MG algorithm. First, we impose an additional assumptions that the link failures are spatially independent, 

i.e., the Bernoulli states Aij(k) and Ai m (k) of different links at time slot k are independent. Define the 

sets Y(Qi) := {yji : j G Qi} and the class Y(Oi) := {yji : j G Oi], where Oj C Jlj. One distinct set 

Y(Oi) is assigned to each distinct subset Oi of Qi. (Clearly, Y(Qi) belongs to a class of sets Y{Oi), as 

fij is a subset of itself.) With P-AL-MG, at iteration k, minimization is performed either with respect 

to Xi, i G {l,...,iV}, or with respect to some Y{Oi). If none of the neighbors of node i receives 

successfully a message, then iteration k is void. Define the following collection of the subsets of primal 

variables: II := {{xi}, ..., {xn},Y(Qi), ...,F(J1jv)}. Collection II constitutes a partition of the set of 

primal variables; that is, different subsets in II are disjoint and their union contains all primal variables. 

Further, denote each of the subsets {x^, Y(Oi), y(fij), with appropriately indexed Z s , s = 1,...,S. 

Then, with P-AL-MG, at time slot k, L(z) is optimized with respect to one Z s , s = 1,...,S. Define 

£(fc), k = 1, 2, ..., as follows: £(&) = s, if, at time slot k, L(z) is optimized with respect to Z s ; £(£;) = 0, 

if, at k, no variable gets updated-when all transmissions at time slot k are unsuccessful. Denote by 
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P{Z S ) = Prob(£(/c) = s). Under spatial independence of link failures, P{Z S ) can be shown to be 
strictly positive for all s. It can be shown that £(/c) are i.i.d. Consider now (16) and P-AL-MG. All 
results for P-AL-G remain valid for P-AL-MG also-only the expressions for the expected decrease of 
L(-) per iteration, i/)(z), (Lemma 7), and the proof of Lemma 8 change. Denote by L^ Zs \z) the optimal 
value after minimizing L(-) with respect to Z s at point z (with the other blocks Zj, Zj £ Z s , fixed.) Then: 
4>{z) = £)f =1 p ( z s) {L {Zs) - L(z)) ■ Recall <f>(z) = -ip(z) and the set T(e), for some e > 0. Lemma 8 
remains valid for P-AL-MG. To see this, first remark that 4>{z) > 0, for all z € F. We want to show 
that 4>(z) > 0, for all z £ T(e). Suppose not. Then, L(z) = L( z >\z), for all Z s , s = 1,...,S. Then, 
in particular, L(z) = L^ z, \z), for all Z s in the partition II. Because P(Z S ) > 0, Vs, this implies that 
the point z is block-optimal (where now, in view of Definition 2, Z s is considered a single block). By 
Assumption 3, z is also optimal, which contradicts z G T(e). Thus, <fi(z) > for all z G T(e). The proof 

now proceeds as with the proof of Lemma 8 for algorithm P-AL-G. 

Convergence proof of the P-AL-BG algorithm. P-AL-BG is completely equivalent to P-AL-G, 

from the optimization point of view. P-AL-BG can be modeled in the same way as in Alg. 2, with 

a difference that, with P-AL-BG: 1) there is a smaller number (= N) of primal variables: zi := Xi, 

i = 1, ..., 7Y; and 2) Prob(£(/c) = 0) = 0. Thus, the analysis in section V is also valid for P-AL-BG. 
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